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Abstract 

Based on the here developed functional analytic machinery we extend the theory 
of operator sampling and identification to apply to operators with stochastic 
spreading functions. We prove that identification with a delta train signal is 
possible for a large class of stochastic operators that have the property that the 
autocorrelation of the spreading function is supported on a set of 4D volume less 
than one and this support set does not have a defective structure. In fact, unlike 
in the case of deterministic operator identification, the geometry of the support 
set has a significant impact on the identifiability of the considered operator 
class. Also, we prove that, analogous to the deterministic case, the restriction 
of the 4D volume of a support set to be less or equal to one is necessary for 
identifiability of a stochastic operator class. 
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1. Introduction 

In the fields of wireless communication and radar and sonar acquisition, a 
sounding signal that is known both to the sender and to the observer is sent into 
the channel in order to determine the characteristics of the channel from the 
received echo. Similarly, in control theory, the problem of identifying a system 
from the output to a given input is called system identification. 

Both deterministic and stochastic operator identification have their roots in 
the works of Kailath [1] and Bello [2] . They suggested a criterion for identifiabil- 
ity based on the spread of the operator, defined as the area of the support of the 
spreading function. In [3, 4] the criterion that it is necessary and sufficient that 
the spread must be less than one for a deterministic operator to be identifiable 
has been theoretically verified and justified, giving new life to this engineering 
dogma. The universal boundary of one for the spread of the deterministic oper¬ 
ator to be identifiable is closely related to the Heisenberg uncertainty principle 
of quantum mechanics. This connection is evident in the time-frequency analy¬ 
sis nature of the proofs given in [3, 4], as these rely on the representation theory 
of the Weyl-Heisenberg group. 

The utility of weighted delta trains as a theoretical tool for the study of 
identification and sampling theory stems from their position as infinite band¬ 
width unbounded temporal support sounding signals. Recently, more practical 
identifier signals for a class of channels with a parametric model on the chan¬ 
nel structure have been discovered [5, 6]. In another development, it was shown 
that a stiff requirement to know the support of the spreading function (precisely 
the set whose area must be less than one) prior to sounding can be removed by 
using compressed sensing techniques [7, 8]. 

Here, we continue to rely on weighted delta trains as identifiers to develop a 
parallel theory of identification of operators with stochastic spreading functions. 
Since stochastic operators include deterministic operators as special case, it is 
tenable to suppose that in some form the restriction on the spread to be less than 
one retains its relevance. However the rules of the game change, as the object to 
recover, the spreading function, belongs to a much larger class of objects. The 
common strategy to circumvent these difficulties is to decrease the complexity 
of the channel by requiring the spreading function to have a degenerate form, 
stationarity in both the time and frequency variables, which corresponds to 
a WSSUS channel. The study is hereby reduced to the recovery of the so- 
called scattering function, a deterministic function in two variables, defined 
below in (2). Even in this simplified setting, the communication engineering 
literature still seems to accept the insight of Bello that the area of the support 
of the scattering function is a necessary requirement for the identifiability of 
the operator [2]. In fact, even this characterization of the fading properties of a 
channel is discarded in favor of a simpler yet spread factor given by the area of 
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the minimum rectangle that encompasses the support of the spreading function 
(and hence, scattering function) in the time-frequency plane. This rule of thumb 
is perpetuated in the classical books as recent as the monograph of Proakis [9] . 

In [10], we argue that as in the deterministic case, the condition for the spread 
factor to be less than one is sufficient in the case of identifiable WSSUS channels, 
and establish the direct applicability of time-frequency analysis techniques of 
Kozek, Pfander and Walnut in this simplified stochastic setting. In [11], we 
assume functional analytic results proven here and give a detailed analysis of 
the general case of stochastic operator sampling with a fully stochastic spreading 
function. The work in [11] extends sampling results for operators and discusses 
their applications. A surprising corollary shows that using weighted delta trains 
as identifiers for WSSUS channels allows the recovery of the scattering function 
from the autocorrelation of the received signal irrespectively of the area of the 
support of the scattering function. 

Here, we settle the question of the identifiability of stochastic operators with 
a general necessary and sufficient Theorem 4.3. It turns out that the volume of 
the set M, the support of the stochastic spreading function, alone is not enough 
for identifiability of the corresponding operator. The geometry of the set M 
plays an important role for the possibility of identification. 

The popular and herein used model for channels and linear time-variant 
(LTV) systems is 



( 1 ) 


where Tt is a time-shift by t, that is, Ttf{x) = f{x — t), t £ K, and M^, 
is a frequency shift or modulation given by M,jf{x) = f{x), i/ G M.. 

Taking Fourier transforms, it follows that Myf{^) = /(^ — v) = T^f{C) for all 
^ G K. The function ri(t, v) is called the (Doppler-delay) spreading function of 
H. Classically, the domain and codomain of H are taken to be the Lebesgue 
space of square integrable functions L^(K) or the discrete finite dimensional 
space Cl- More generally, f{x), ri{t,iy) and g{x) = Hf{x) can be elements 
in spaces of generalized functions, such as the space of tempered distributions 
the continuous dual of the space 5(M‘^) of infinitely differentiable rapidly 
decaying functions. 

It is common that models of wireless channels and radar environments take 
the stochastic nature of the medium into account. In such models, the spreading 
function r]{t, v) or the sounding signal f{x) in (1), or both, are random processes 
(that will henceforth be denoted by boldface letters) such that, for example, 
every sample of the spreading function ri{t,v;uj) belongs to one of the spaces 
mentioned above. In this paper we consider only the spreading function to be 
stochastic, leaving the sounding signal completely deterministic. 

Usually, the operator is split into the sum of its deterministic portion, repre¬ 
senting the mean behavior of the channel, and its zero-mean stochastic portion 
that represents the noise and the environment. We assume that this decom- 
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position has already taken place and focus on operators with purely stochastic 
zero-mean spreading functions. For a treatment of the deterministic part, we 
refer to [3, 4, 12]. 

The statistic that presents the most interest in this setting is the autocorre¬ 
lation of the spreading function 

Rr,{t, V, t', v') = E|?7(t, v) T]{t', i/')}, 

and we will pursue the goal of determining Rrf from Rnf, that is, Rrj from the 
autocorrelation of the stochastic channel output Hf (see Definition 3.1). The 
time-varying case most studied in the literature assumes the special form 

Rn{t, v] t', v) = Cn(t, v) d{t — t') 5{v — v). (2) 

Such operators are referred to as wide-sense stationary operators with uncor¬ 
related scattering, or WSSUS. The function Cn{t,v) is then called scattering 
function [13, 14, 10]. Our results do not presuppose the stationarity of H, 
instead, they include it as an interesting special case. 


it',1.') 


{f 


{t',v’) 




(t,v) 

(c) WSSUS 


Figure 1: Types of distributional support sets of autocorrelations of spreading 
functions. 


Under the a priori assumption that the operator H: X ^ Y belongs to class 
of linear operators H, identification of the operator from the received echo Hf 
is possible only if for some sounding signal / the mapping : if i—^ iJ/ is 
injective, 

HJ = H^f ^ ill = i?2- 

For linear mappings between Banach spaces to identify H in a stable way, we 
require 4)/ and its inverse to be bounded: 

A\\Hi-H2\\^<\\Hif-H2f\\Y<B\\Hi-H2\\^ ior all H2 € H. (3) 

In those cases when H is closed under addition, this is equivalent to 

4l|lii|l„ < ||ii/l|y < BJliill^ for all FiGH (4) 
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for some A,B > {). The choice of Banach space norms on Y and "H is thus 
important. 

In the following, we use the symbol < to abbreviate inequalities up to a 
constant, that is, f(t) < g{t) if there exists C > 0 such that f{t) < C g{t) for 
all t. Additionally, f ^ g means f g and f ^ g. 

One major contribution of this paper is to design Y and H for the identifica¬ 
tion inequality (3) to hold for stochastic operators accommodating generalized 
functions as input signals and generalized stochastic processes as spreading func¬ 
tions. 

In Theorem 3.3 we obtain direct generalization of results [4, 3, 12] that deal 
with deterministic channel operators. Cited results show that delta trains as 
sounding signals identify a large range of so called operator Paley- Wiener spaces 
from the echo Hf as discussed in Section 1.1 below. For the case of stochastic 
operator identification, the reconstruction formulas for the autocorrelation of 
the spreading function R^i given the autocorrelation of the stochastic channel 
output RHf can be found in [11], a paper that also addresses sampling the¬ 
ory connection of stochastic operator identification and practical aspects of the 
proposed technique. This paper provides mathematical backbone of the theory 
developed. 

The possibility of deterministic operator identification by delta trains is 
linked to the invertibility of a submatrix of a finite dimensional Gabor system 
that corresponds to the geometry of the support set [3]. A finite-dimensional 
Gabor frame is defined as 


G = {M'r'=c}^j4 

where the finite-dimensional translation operators and modulation operators 
M* operating on a vector c S C'^ are given by 

(T^'c)p = Cp-k and {M’‘c)p = 

We extend the same technique to stochastic operators. We find that stochas¬ 
tic operator identification using delta trains is still possible if the finite-dimen¬ 
sional matrix G (g) G|^ is invertible, where the index set A is now induced 
by the geometry of the support set of the autocorrelation of the spreading 
function supp t', z^'). We will show that analogous to the determinis¬ 

tic case, from the dimensionality considerations it is evident that the restriction 
on snpp to have 4D volume less than the critical volume one is 

still necessary for delta train identification. In addition, we show that this con¬ 
straint to volume less than one also holds if we replace the delta train by any 
distribution in the considered herein modulation spaces. 

In [15] we developed the reconstruction formulas for the stochastic case and 
discussed more applied aspects of the technique. We discovered that in the case 
of stochastic operator identification, there exist defective configurations of the 
said support (which we call patterns) that prevent successful identification by 
delta trains. Moreover, this effect persists regardless of level of refinement of 
the time-frequency grid (that is, of the parameters a, b in Definition 1.1). 
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In this paper, we also continue the discussion of defective patterns. It turns 
out that the two families of defective patterns that were determined in [11] to 
define operator classes that cannot be identified by weighted delta trains me, 
are, in fact, globally defective in a sense that no sounding signal / identifies 
them. 

The paper is structured as follows. In Section 1.1, we give the well estab¬ 
lished definitions and theorems from the theory of deterministic operator iden¬ 
tification. In Section 2 we define the Banach spaces S'tOPW(M) of stochastic 
operators that are natural choices to request identifiability of, and develop the 
functional analysis tools to successfully deal with them, see, in particular. The¬ 
orem 2.8, Theorem 3.3 and Theorem 4.7. In Section 3 and Section 4 we describe 
sufficient and necessary conditions on M for the identification of operators in 
S'fOPW(M). In Section 5 we introduce criteria for defective patterns. We de¬ 
termine two families of defective patterns that give rise to support sets M such 
that StOPW{M) is impossible to identify any sounding signal /. In Section 6 
we give a generalized version of the Theorem 2.1 in [16], a result needed to 
derive theorems in the other sections. 

1.1. Sampling and identification of deterministic operators 

Equivalently to (1), any operator H acting on one-variable signals can be 
represented in a weak sense by 

(i) its time-varying impulse response h(x,t) = / r]{t,v) dn, then 

[Hf){x)= J h{x,t) f{x -t) dt, 

(ii) its kernel k(x, y) = h{x, x — y) = f tj(x — y, v) dv, then 

{Hf){x)=J K{x,y)f{y) dy, 

(iii) and its Kohn-Nirenberg symbol (j{x,ff) = then 

{Hf){x)= J a{x,Om d^. 

In the last equation, the symplectic Fourier transform is given by 

(J-, 77 ) {x ,0 = JJ «*) dtdm 

The spreading function r](t, n) enjoys a particularly simple relationship to 
the short-time Fourier transform (STFT) V^p■. —>■ defined as 

V^f{t,u) = {f,M,Tt^) (5) 

for any window p G S(U‘^). Note first that the STFT is symmetric with respect 
to / and up to a unitary phase factor, that is. 
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For all /, G S{R‘^) we then have the useful equality 

= {v,Vf(p). 

The inner product (■, ■) and the dual pairing (•, •) in case of distributions are 
taken to be conjugate linear in the second component. 

We will say that H belongs to an operator Paley- Wiener space if the support 
of the spreading function r]{t,v) = iFsCr{x,^) is contained in a subset S of the 
(t, i/)-time-frequency plane, usually taken to be compact, 

OPW(S') = {H: L^(]R) —L^(M) such that a G supp C S}. 

The space OPW(S') becomes a Banach space given a Hilbert-Schmidt norm 
ll'^llopw “ II^PfllL 2 (B 2 )- Colloquially, we refer to H as “bandlimited” to S. 
Based on ideas from [1, 2], first results in operator identification were obtained 
for deterministic operators with spreading function supported on a rectangle of 
area one in the time-frequency plane [3] . Later it was proven that identihcation 
is possible for a larger class of operators with spreading functions supported on 
a fixed bounded set of arbitrary shape, not just a rectangle, as long as the area 
of it is less than 1 [4] . To obtain general identification results, it is necessary to 
rectify the support set S as it is done in the theory of Jordan domains. 

Definition 1.1. The set S is {a, b, A)-rectified if it can be covered by L = ^ 
translations A = {{kjJj)}fAQ of the rectangle □ = [0, a) x [0, b) along the lattice 
aZ X 5Z: 

L-l 

S' C □ + {akj, blj). 
j=o 

For compact sets the Lebesgue measure agrees with the outer (respectively, 
inner) Jordan content denoted henceforth vol’*’ (respectively, voW). 

Lemma 1.2. For any compact set S of measure p{S) < 1 there exist a,b > 0 
and A such that S is {a,b, A)-rectified, L = -^ is prime, and S C [0,T] x 
[—12/2,12/2], where Tb = 1 and 12a = 1. 

Proof. A proof without the requirement that L must be prime can be found in 
[17]. It is easy to see that requiring L to be prime does not lose generality and 
can always be achieved at the expense of further reduction of parameters a, b 
and by allowing the inclusion of some rectangles that do not intersect S. □ 

Definition 1.3. For a, £ > 0 we say r{t) generates an {a, e)-partition of unity 
{r{t + ak)}kez if 

suppr(t) C (—£, a-I- e), and r{t -\- ak) = 1. 

fcGZ 


An ((a, b), £)-partition of unity of the two-dimensional plane is defined similarly. 
If, in addition, the function r{t) belongs to the space Ac, then we say that r{t) 
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Figure 2: An (a, &, A)-rectified support set of a deterministic spreading function 
in the time-frequency plane. 


forms a bounded uniform partition of unity [18]. Here, A = is a Fourier 

image of a space of Lebesgue integrable functions with norm ||r||^ = ||f||^i, and 
the subscripted Ac is the subspace of functions in A with compact support. 

Theorem 1.4. [4, Theorem 1.7], [8] Let S' C be a compact set with measure 
/i(S) < 1 such that S is {a, b, A)-rectified in the sense of Definition 1.1, and 
SC [0, X Then there exists a vector c S so that 

die — ^ ^ Cn mod L ^njL 

71 

identifies OPW(S) in a sense of (4), and for any H G OPW(S) 


L-l 

h[x -\-t,t) = aL EE Oj^q Hmc{x — a{kj q)) 

j=o q& 

X r{x — akj) ip(t a{kj q)) 

unconditionally in Here, the coefficients Oj^k are uniquely determined 

by the choice o/{c„}, and r(t), ip{f) are functions that are {a,£)- (resp., (h,£)-) 
partitions of unity in time (respectively, frequency) domains, with £ > 0 depen¬ 
dent on S. 

Theorem 1.4 holds not only if S is compact, but for all regions S whose 
Jordan outer content is less than one [4]. 

2. Stochastic modulation and stochastic Paley Wiener spaces 

Let (H,P, S) be a probability space, and denote RV(H) the space of zero- 
mean complex-valued random variables r(u}) : H ^ C. A general treatment 
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of generalized functions as mappings S(R‘^) —>■ C and of generalized random 
processes as mappings —>■ RV(n) dates back to [19]. However, for our 

purpose it is more convenient to deal with Banach spaces as domains and norms 
instead of Frechet spaces and infinite families of seminorms. We will thus restrict 
our attention to stochastic versions of the modulation spaces and M°°. 

Definition 2.1. Let (p G be a fixed non-zero window, and 1 < p,q < 

oo. Then the modulation spaces consist of all tempered distributions 

/ G 5'(]R'^) such that the short-time Fourier transform belongs to the Lebesgue 
space that is, 

= {/ G S{R^) such that ||/||mp(r<J) = (^Jdi^ < oo}. 


is a Banach space; changing (f leads to equivalent norms. Moreover, 
M°° = {M^y, where M°° is defined by replacing the integral by taking the 
supremum over all {t, u) G . 

We will use the following property of the space of functions [18] 

(K'^) § (M‘^) = (]R2<i). 

Here, the projective tensor product space is defined as 


= W G f{x,x') = ^ fnix)g„{x') and 


( 6 ) 




We consider generalized stochastic processes as mappings from to 

RV(B) with autocorrelations in an idea first presented in [20] and 

developed further independently of our work in [21]. 

We denote by B{X) the unit ball in the normed space X. 

Definition 2.2. A generalized stoehastic process f on is a bounded lin¬ 
ear map —)■ RV(f2). The space of all generalized stochastic processes 

consists of the equivalence classes of maps -G RV(B) with the usual 

operator norm 

ll/llstM“(K‘*) = ll/(‘^)llRV(n). 

It is denoted StM°° (K"^); the St in StM°° stands for “stochastic”. 

Definition 2.3. Let f,gG StM°°. The cross-correlation distribution 
Rfg -. -G- C for all ip,i^ G M\R‘^). 


is defined by 

RfgivA) = {Rfg,V®^) = {f{y^),9W)EV = E{/(‘/5)g(V')} 
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for rank-one tensors ip® ip and extended in a linear way to finite sums. Consider 
0 = 


\Rfg{^)\ = \RfgC^^i®i’i)\ = 






i-1 


RV llfl'(V'i)ll RV — \\f\\stM°°\\9\\stM°° Ml IIV'illMi. 

i=l i-1 

Since this holds true for any tensor representation of 0, it follows that 

\Rfgm<\\f\\stMMstM-\m Mi§Mi 
for all such 6. We then extend Rfg to the whole of 

by continuity. The cross-correlation Rf = Rff oi & generalized stochastic pro¬ 
cess / with itself is its autocorrelation. 

Lemma 2.4. For all f G StM°°{R‘^), ^ P/IIm-(r2‘1). 

Proof. We begin with an observation that taking ip = we guarantee 

= sup (/M,/M)rv< sup (/(</5 ),/(V'))rv 

VpGB(M1(B'1)) <^,i/>GB(M1(B-1)) 

< sup II/(¥i)IIrvII/(V')IIrv = ll/llstM“(B‘i). 

By [18, Theorem 5.4, p. 21] and its proof, every operator T: —>■ M°° is in 

a one-to-one correspondence with a kernel kt G such that {Tp,ip) = 

{kt,p®iP) for all p,ip G moreover, x ||kt|Im<»(b 2 <i)- 

In particular, consider an operator T: —>■ M°° such that Tp = Rf{p, ■). 

Clearly, kt = Rf. We now compute 




sup \{fiF),fW)\ 

sup \{Tp,ip)\ 

VP.V'6B(M1(B‘1)) 


— ||T"|Im 1->-M“ II^T|lM“(B2ti — ll^/llM“(B2<i), 


□ 


An observation crucial for operator identification is the characterization of 
the modulation space as Wiener amalgam space W{A,i^) [22], defined with 
p = 1 by 

1 

1T(A,F) = {/ G Aloe such that ||/||w(a.£p) = ( X! 11/('^) 


where ip G is a bounded uniform partition of unity, see Definition 1.3. 

The norm jj • does not depend (up to equivalence) on the choice of ip. 

The space W{A,£°°) is defined similarly, with usual modifications. 
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The (distributional) support of a generalized stochastic process / is defined 
as the complement of the largest set S such that for any (p G entirely 

supported within S, f{(p) = 0 as elements of RV. 

Theorem 2.5. Any bounded linear operator rj: —)■ RV with suppry 

compact extends to a bounded linear operator rj : W{A,£°°) -G RV. 

Proof. Without loss of generality, we can rescale the argument variables (t, ly) 
in such a way that suppry C [—f, f) x [—i). Let if G A^ he such that it 
generates a bounded uniform partition of unity as in (7), and whose support is 
large enough to cover the support of r/, that is, 

and (8) 

neZ‘‘ 


For any ip G W{A,£°°) by definition we have 

\\p\\w(A,t--) = sup \\Tnlf pWa < OO. 

In particular, ifp G A, and ipp is compactly supported, thus if p G W{A,£^). 
In fact, since support of if is compact, the set T = {n such that suppT^'i/; D 
supp^ ^ 0} is finite, |J^| < oo. We further observe 

< \p\ llV'IU sup||r„V' Aa < l-^l IIV'IU IIt’II W{A4^), 

where we used the fact that A is a Banach algebra under pointwise products. 
We can now define 

r]{p) = r]{ifp). 

This obviously defines a linear mapping W{A,£^) -A RV. For any choices if, if' 
satisfying (8) we have [if — if')p = 0 on supprj, therefore, it is well defined. 
Boundedness follows by observing 

ll^(<7’)ll RV ~ NCV- 7’)ll RV 

- ll^llw(yl,£i)^RV Wi’pW W{A,P) 

<c\M 

StM'=°(K^'i)\\p\\w(A,f=°), 

where we used (9) and recalled that = W{A,£^), and StM°° = £(M^,RV). 

□ 

Theorem 2.6. For all H : M^(M) -A StM°°(M.), there exists a unique spreading 
function r]: -A RV such that for all f,pG M^(K) 

{Hf,p) = {ri,Vfp). 


II 


Proof. The proof follows closely the proof of the kernel theorem for modulation 
spaces in [23, Theorem 14.4.1, p. 314]. □ 


Definition 2.7. We say that an operator H: M°°(R) —)■ belongs to 

the stochastic Paley-Wiener class S'tOPW(M) if 

{Hf, = (77, Vfif) for all / G ^ G 

the support of r/ is compact and the distributional support of Rr, is a subset 
of the closed set M C suppr 7 0 suppTy. The space S'tOPW(M) inherits the 
operator norm 

Theorem 2.8. Any bounded linear operator H: M^(K) with 

suppr; compact extends to a bounded linear operator H: — >■ StM°°{M.). 

Moreover, 

WHfWs^M^ < CMstMMWM^ for all f G M~(K). 

Proof. Let 77 G StM°°{M.‘^'^) with supp 77 C M such that M is compact. From 
[24, Proposition 4.2, part 1] we know that for ip G / G we have 

G WiAJ°°) and 

By Theorem 2.6, {Hf,(p) = {T],Vfip), and by Theorem 2.5, 77 accepts Vfp G 
W{A,£°°) as input, so we can estimate 

\{Hf,p)\ = \{'n,Vfp)\ 

<C\\7l\\ 

StM’^ \\VfP\\w{A,e’^) 

Taking the supremum over all (p G B{M^(M.)) on both sides gives 

\\Hf\\stM°° ^ ^WvWstM^^WfWM^^, 

and ultimately, for the operator norm, 

ll■^listOPW(M) — CM 

Lemma 2.9. For all f,g G StM°°{M.‘^), (V'y/, VV9 )rv = where! 

is the reflection in the fourth variable: If{-, •, •, v') = /(•, •, •, —v'). 

Proof. By Dehnition 2.3 of Rfg, 

{v^f, y^Rv = y^giif c)] 

= E[{f,M,Ttp) t/-)} 

= {Rfg,M,^Ttp (g) tf) 

~ yip®f> ,—v ). □ 

Remark. Note that we only used that the space RV(n) has a Hilbert space 
structure. The theory developed above still holds if we replace RV(H) with an 
arbitrary Hilbert space R, and E{ •, • } with the inner product (•, 
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3. A sufficient condition for the identifiability of StOPW(M) 

By identifying the stochastic operator H, we mean determining Rri{t, v] t', v'), 
the autocorrelation of the spreading function rjjf (t, v), from x'), the au¬ 

tocorrelation of the received response H f{x) to a fixed sounding signal /. More 
generally, given a class of stochastic operators not necessarily closed under 
addition, we would like to be able to tell apart any two operators using (3). 
Since the autocorrelations in question satisfy {Rh/, = f ® f)^ 

we are trying to invert in a stable way the linear mapping $ —>■ 

given formally and weakly by 

= (10) 

We reprise here the definition (3) tailored to the map and the class 5'tOPW(M) 

Definition 3.1. We say that / G identifies the set S'tOPW(M) if the 

linear mapping given by (10) is boundedly invertible, that is, if there exist 
constants 0 < A < < oo such that for all pairs Hi, H 2 G StOPW{M), 

A||i?Tji — i?,j2 IIm“(R<‘) — W^Hif ~ RH2f\\M°°{B.^) — ~(H) 

Our methods require the support set of the autocorrelations, or rather, their 
superset M, to be rectified satisfying the symmetry properties of the autocor¬ 
relation function. 

Definition 3.2. We say the set M is symmetrically {a, b, A)-rectified if it can 
be covered by the translations A = {{kj,lj,kj,lj)}.^^ of the prototype paral¬ 
lelepiped = [0, a) X [0, b) X [0, a) x [0, b) along the lattice (a, b, a, b)lfi, that 
is, 

,7 

M C [J {akj,blj,ak'j,bl'j), (12) 

j=o 

such that the 4D volume of is small: ab = j-, with L is prime, and the index 
set A is an admissible set, in a sense that 

{k,l,k',l') G A ^ {k,l,k,l),{k',l',k',l'),{k',l',k,l) G A. (13) 

The rectification (a, 6, A) is precise if we have equality in (12). We will always 
denote T C the projection of A onto the first two (and by symmetry, the 
second two) indices, that is, P = {7 = (fc, 1) \ {k, I, k, ^) S A}. Clearly, A C P x P. 

The following theorem is an identification result corresponding to operator 
sampling results in [11]. It provides justification to the formal calculations that 
lead to the reconstruction formula (10) in [11]. 

Theorem 3.3. Let M be symmetrically {a, b, A)-rectified with Lfi = jAj. If 
some c G C'^ generates G{: ,kL -\-1) = [M* such that the submatrix 

{G O G)\A is invertible, then 

ll’?llstM~(R 2 ) ^ ll-ffm|lsiM~(R) for any H G StOPW{M), 
where the sounding signal is given by mc(x) = mod l b(x — ak). 
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Proof. In the following, by abuse of notation, ||/||M~([o,a)) = ll^ 9 /llL~([o,a)xR). 
Consider 


ll-ffuicll 


sup WRHm^X + an,x' + a^^')llM~([ 0 ,a) 2 ) 

n,n'GZ 

sup sup llRnm^ix + aj + amL,x'+ aj'+ am'L)\\^.^ 

Rnm, {x + an, x' + an!) M^an'fi'l) M^an’i^h') 


sup 


M“, 


where we use n = mL + j, n' = m'L + j' and apply Lemma 3.5 below with 

with ^'(b) chosen later. Consider the 

expression inside the norms 


= E j y]] Hm^{x + an) J 


Hmc{x' + an') 


,-27r*an'7'^(y 


Km'^'E 


The treatment of both factors is identical, we only detail the first. 


Rj = Y, Hm^{x + an) 

= EE Cn+kh{x + a(j + mL),X — ak) e 2'7rza0+ml,)7 

m^'L /cGZ 

= EE Ck+mL+i h{x + aj + amL, X — ak) e 27'-*amL7 ^ 2 maj-y 

m^’L k^T, 


= E] Cfe+j h{x + aj + amL,x — ak) e 2 '^*amL 7 

_mGZ 


g-27rmi7 


— by Lemma 3.6 — 


= b‘^Y E -ak,-f- bl) e2-h^+a9)(7-ft0 g-2^*aj7 

feGZ iGZ 

= ^^EE Ck+J ■nix -ak,-f- bl) 

feGZ ZgZ 

= ^^EE (M-^T-^c)^ nix -ak,j- bl) 

feGZ ZGZ 

= b^Y ^xki nix + ak,j + bl) 

k,iei. 
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where in the last step we rename k = —k, I = —I and denote = 

.. Now we return to the original ||i?nic||5jjv^oo(R) 




= 6^^ sup E ^ Gj^ki ri{x + afc, 7 + bl) e^”^G-bD 

k,i& 

x( E Gj.^k'v'nix'+ ak',i+ 


k'.l'GZ 


M^([0,a)2) 


sup 


( X! ^kki Gf^k'i' Rri{x + ak, 7 + bl, x' + ak', 7' + bl') 




X e 


2 nix{j-bl) ^ 2 ^ix'{Y-bl') 


X M,yTt (p{x) tp{x') M^Tr (/?( 7 ) M^>Tr' 


L“(([0,a)xB)2) 


where ip{x) G 5 (K) is a smooth window as in ( 5 ). We substitute x = x + ak,^ = 
7 + bl, x' = x' + ak', 7' = 7' + bl' 


sup 


3 , 3 '&L k,l,k',l'GZ 


E {G3M Gy,k'i' Rr,{x,-i,x',i) 


X ipi"/ -bl)'>p{y - bl'), M,,Tt+akf{x)M,,,Tti+ak''^[x') 


X M^_akTr+bl fil) M(^'_ak'Tr'+bV 


denote for simplicity 7, a;', 7') = 7, x', 7') ^'i') and narrow 

the domain of r, t' to [0, b) 


> sup sup sup sup sup 


z/,iv''GMt,i'G[0,a) r,T'G [0,6) JJ'GZl ^ i k' l'£Z 


^ ^ ^ Gj^ki R-q{x^'^^x ,'y ) 


X ^^(7 - hi) ^(7' - hV), M^Tt+ak ^{x) Mj,>Tt>^ak> ^{x') 


X M^-akTr~\-bl ^{'l) M^>-ak'Tr>+bl' 
by selecting '0(7) such that •0(7) = 1 on [ 0 , 6 ) +supp (p{'y), '0(7) can be dropped 


sup sup sup sup sup 

tjt'G [0,a) TjT'G [ 0,6) 3 , 3 'GlyL ' k I k' V& 


( ^ ' Gj,kl Gji^k'l' Rrjix, ^ , X ,7 )) 


X M,,Tt+ak ‘P(x) M,,>Tt>+ak' ‘P(x') 


X M^-akTr+bl fil) M^i-ak'Tr'+bl> 
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by the condition on the support of by Lemma 3.7 we can reduce the sum¬ 
mation to (fc, I, k\ I') G A 

X sup sup sup sup sup Gj,kl Gj'^k'l' 

r,T'G [0,6) jJ'GZL k,l,k',l'^A 

X V^Rrj{t -\- ak, I'jT + bl,^ — ak; t' -\- ak\ t' + bl', — ak') 

by assumption, the submatrix {G ® is invertible, thus the finite vector 

norms are equivalent |l(G®G)|^u||^ x ||u||^, and we can continue 


X sup sup sup sup sup 

I/,!.*'GE [0,a) ^,^'GE r,T'G [0,6) {k,l,k\l')^A 

V^Rrj{t ak, v,T + bl,^ — ak] t' + ak', v' , t' + bl', — ak') 

we can return to k, I, k', I' G Z, and exchange the order of supremums 


sup supi V^Rr,{t,v,T,^-, t' ,v' ,t' 

h'l'a 7 . ^ 


k,Ak',l' 


where v, v' G 


G a[k, k + 1), G a[k', k' -|- 1), r G b[l, I + 1), t' G b[l', Z' -|- 1)| 




\StM° 


□ 


We have used the following terminology and lemmas. 

Definition 3.4. A sequence {/«} in a Banach space X is an £P-Riesz basis for 
its closed linear span if there exist constants A, B > 0 such that for every finite 
sequence {c„} G £*’(Z) 

A||{c„}||p < ||^c„/„||^ < B\\{Cn}\\p. 


Lemma 3.5. Given an i°°-Riesz system {'^ mL+],m' L+j'Vfi of 


sup sup \{am,m'}\ 


sup 


j-,j m,m'GZ 




L°°(E4). 


Proof For any j,f G Zl, {'b mL+j,m,'L+j'}m,m' ez are £°°-Riesz bases for their 
respective linear spans with the same Riesz bounds, that is, 

sup |{am,m'}| “ ||{Om,m'}ll^oo[m,'m'] 


IE 


m,m' 


a. 


m,m' ^mL+_7,m'L+_7' 


M^(E 2 ) 


m,m' GZ 


dn 


'm,m' ^mL-\-j,m'L-\-j' 


□ 
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Lemma 3.6. With the notation used above, 


Y,Kx + aj+ amL, x-ak)e ^ ^( 3 . 

m^Z ZGZ 

Proof. Let the non-normalized Zak transform '■ L^(M) —>■ L'^ ([0, a) x [0, a“^)) 
be defined by 

Zaip{x, v) = ^ ip{x — am) 

mGZ 

Since h{f^,t) = T]{t,i'), by the Poisson summation formula for Zak transforms 

[23] 

h{x + aj + amL, x — ak) e“ 2 vrjamL 7 

m^Z 

= {ZaLh{ ■ ,x - ak)) {x + aj,j) 

= 6 ^ X - ak)) (7, -x - aj) 

= 6 ^ (Zbr 7 (x - ak, •)) { 7 , -x - aj) 

_ ^2-Ki{x-\-aj)'y -ak,-f- bl) 

/GZ 

= b^J2ri{x 
iez 

Let S'e denote the e-neighborhood of a set S' C K", that is, 

Se = S + eS(M”). 

Lemma 3.7. Let A index the set of k G Z" such that the e-neighborhood of the 
support of R{x) is covered by disjoint translations of a parallelepiped [0, a) = 
[0, tti) X • • • X [0, a„) along the lattice aZ” 

(suppi?(x))e C a|J^^^[fc,fc +1). (14) 

Then for any <p{x) supported on an e-neighborhood of the origin eyB(K"), and 
for any t G [0,a), we have 

^feGZ" ^k{R{x),Tt+akT{x)) = Yf.^j,^‘^k{R{x),Tt+ak(pix)) . 

Proof. For all t G [0, a), 

supp Tt+ak<pix) C [ak, a{k + 1))^ ■ (15) 

Taking complements in (14), we get 

supp i?(x) n (u,. ^[a/c, a(fc + 1))^ =0. (16) 
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Then 

Y,ak{R{x),Tt+,Mx)) = (^Rix),Y,^kTt+aMx)) + 

k^Z k^A k^A 


Since by (15) the suppZk^A °-kTt+akV>{x) Q (Ufc^A(“^> “(^ + 1))) ^ which is 
disjoint from suppi?(a;) by (16), the second summand is zero. □ 

We will also need the equation [11, (5)] and the following lemma. 

Lemma 3.8. [11, Lemma 9] Let A be a fixed finite pattern, AC {(0,0),..., (L — 
1,L — 1)} that satisfies (13) and let G G . The following are equivalent: 

(i) For each positive semi-definite Y G , there exists a unique X G 

such that a) X is positive semi-definite, b) supp AT = A, and c)Y = 
GXG*. 


(ii) If an hermitian matrix N G with suppA^ C A solves the homoge¬ 

neous equation 0 = GNG*, then N = 0. 

(Hi) The matrix G 0 has a left inverse (is full rank). 


We are now ready to formulate the first main result about the identification 
of stochastic operators. 


Theorem 3.9 (Sufficient conditions for identifiability). Let M be a symmet¬ 
rically {a, b, A)-rectified set such that L = -^ is prime and |A| < L^. If the 
submatrix 


G® G 


M^T^c® M^'T^'c 


{k,l,k',l')&A 


is invertible for c G C'^, then uic(x) = Zkez ''k mod l 5(x — ak) identifies 
StOPW(M). If the rectification is precise, then invertibility of G ® G\^ is 
also necessary for the identifiability by m^. 


Proof of sufficiency. By Theorem 2.8, Lemma 2.4, Theorem 3.3 and the defini¬ 
tion of operator norms, for any H G StOPW(M) we have 


ll-^llstOPW ^ Il'^llstM” 


1 1 
^ ll-^^llsiOPwll™c|lM“ ^ ll-^llstOPW. 


(17) 


which means that S'tOPW(M) is identifiable by m^. □ 

Proof of the necessity. Given an (a, b, A)-symmetrically rectified set M such that 
the corresponding Gabor submatrix (G ® G)|^ is not invertible, by Lemma 3.8 
we can find a non-trivial hermitian matrix N supported on A in the kernel 
of (G ® G')|y\- It remains to design a pair of stochastic channels H,H' with 
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spreading functions rj and ry', respectively, that are indistinguishable by nic. By 
mixing equation (5) from [11], we get for all {t^v) S [0,a) x [0,6) 


ZaL{Hmc){t + ap, v) 

' -V-' 

Zp{t,v) 


L-1 

p—0 


m.s. 


G 


r]{t + ak, V + bl) 

'■-V-' 

'nk,i(t,v) 


L-l 

k,l=0. 


Denoting = [Zp{t,v)]p^Q and v = [r]k,i]k^ilo (similarly, Z',v'), 

vec'E{ZZ*}{t, V, t', u') = (G Z> G)|^ vecE{w*}(t, t', v'), 
vecE{Z'(Z')*}(t, V, t', v') = {G ® G)|^ vecE{v'(i;')*}(t, v\ t', v'). 

We let S = an independent collection of random variables in RV, 

that is, E{efc_;efcy/} = Sk,k'Si^i' = I{k,l, k',l'), an identity matrix in _ 

Observe that for a sufficiently large K > 0, both I and I + N/K are positive- 
definite. Therefore, there exist random vectors a{k,l),a'{k,l): 'L^i —)■ RV such 
that E{aa*} = I and E{a'(a')*} = I + N/K. We set 


L-l 

T]{t, v)= au,i x^{t - ak,u - bl) 
0 


and define r]'[t, v) similarly with a'. This implies v) = a/c,/Xn(t, v). Thus 

¥.{vv*}{t,vG',v') = ¥.{v'{v'y}{t,vG\v') + xyt,v) Xu{t',v'). 

By construction of N, it follows that 


E{ZZ*}(t, V-1', u') = E{Z'Z'*}(t, v; t', v'), 


Since Zak transform is invertible, Z and Z' uniquely determine Huic and H'uic. 
Therefore, we have Hi y H 2 while RHim^{x,x') = RH^mSx.x'), that is, <i)j is 
not bounded below, and S'tOPW(M) is not identifiable. □ 


We have shown that the identifiability of the class S'tOPW(M) with 4D 
volume of the support set of the autocorrelation of the spreading function ri{t, v) 
less than one is determined by the invertibility of the matrix G (g) G|^. 

Unlike the deterministic case, where OPW(M) allows identifiability if the 
2D area is smaller than one, in the stochastic case the geometry of the support 
set M plays a nontrivial role. In [11] we describe the defective support sets 
M such that for any refinement of the grid (that is, for a, 6 arbitrarily small) 
the corresponding matrix G ® G|^ is not invertible, even though the volume 
vol~'’(M) is less than one, thus, the volume requirement is not sufficient to 
guarantee identifiability by weighted delta trains. In Section 5 we show that 
this phenomenon cannot be fixed by replacing mj, with a different tempered 
distribution. 

But first, we show that the volume requirement is absolutely necessary for 
identifiability of S'tOPW(M). We prove that in the case of vol(M) > 1, the 
class iS'tOPW(M) is not identifiable with any sounding signal / G M°°(]R). 
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4. A necessary criterion for the identifiability of S'tOPW(Af) 


The main goal of this section is to prove that the class S'tOPW(M) is not 
identifiable if vol~(M) > 1 (Theorem 4.7). 

In fact, we prove a stronger and more technical result, Theorem 4.3, that 
ties stability of the evaluation operator to the existence of a bounded left 
inverse of a certain bi-infinite matrix dependent on / and on the geometry of 
M. By Definition 3.1, the stability of is equivalent to identifiability of the 
class S'tOPW(M) by a sounding signal /, thus proving Theorem 4.7, as well as 
Theorems 5.2 and 5.3 below. 

In the following, we shall replace the set M with a subset U that has volume 
larger than one, and that has a precise rectification with A having cardinality 
being a perfect square. As StOPW{M) contains S'tOPW({7), non-identifiability 
of the latter implies the same for the former. 

The proof of Theorem 4.3 uses ideas from [3, Theorem 3.6] and [4, Theorem 
4.1], but it requires also a sophisticated analysis of stochastic modulation spaces. 
We will need the following basic results from time-frequency analysis, given here 
without proof. 

Theorem 4.1. [25, 26, 27] The Gabor system {Ma'pTi,iq go}p,qez 
Riesz basis for if a', b' > 0 satisfy a'b' < 1 and go{x) = 

Let rjQ G 5(K) with values in [0,1] and 


Vo(x) 


® ^ [2 2A’ 

( 0 , 1 ]. 


2k) 


Define f]a{t,iy) = r]o{t/a) Then suppry^ C □ = [0,a) x (0,6). 

Lemma 4.2. [12, Lemma 4-^2] Fix A > 1 with 1 < A^ < ^ and choose rju as 

above. Then the operator P G OPW°°([0,a) x (0,6)) with rja as its spreading 
function has the following properties. 

a) The families 

H = {Xk / a ,\l / b) T(^am,bn) (L i 

H = {gk,l,m,n{t, v) ®gk',l',m',n'{t',v')}, 

^ ~ [Fk,l,m,n\k,l,m,n^'L — {-^Afc/a ^am — Xl/b ^Xl/b Xk / f. [ ndZ 

are i°°-Riesz bases for their closed linear spans in and 

OPW°°([0, a) X [0,6)), respectively. 

b) P is a time-frequency localization operator in the following sense: there exists 

a function do'. M. —>■ K)}", which decays rapidly at infinity, that is, dQ{x) = 

o(x~'’) for all r S N, and which has the property that for all f G we 

have for x G K and ^ G M, 

|^’/(a:)| < II/IIm~(h) Mx), and lP/(f)l < ||/|Im~(r) MO- 
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Theorem 4.3. Fix / £ Let U be a bounded and measurable set in 

with a precise {a, b, A)-rectification, where L = -^ is prime, and |A| = for 
some J > 0. Let 


A = {(fc, I, m, n, k', I', m', n') such that k, I, k', I' £ Z, (m, n, m', n') S A} C Z^ xZ"^ 

(18) 

be a cylinder set extruded from A, and form the bi-infinite matrix 


{M®M)\-. = 


Mr. 




. p,q,p',q'GZ'^ 


from a subset of columns of the tensor product matrix M ® M indexed by A, 
where 


Mp ,q;k,l,m,n — {AI\k/a Tam-\->.l/b P P-Xljh Mbn-\k/a f, ^X^ap T\2pq go), 

with X,a,l3>0 positive constants such that < min(-^, ^), go{x) = e~^ a 
gaussian window, and P is a time-frequency localization operator as defined in 
Lemma f.2. 

If the matrix {M 0 Al)|^ is not stable, then the evaluation operator 

defined by ( 10 ) is not bounded below, and inequality ( 11 ) fails to hold. 

Proof. We denote F the projection of A onto the first two (and by symmetry, 
the second two) indices, that is, F = {7 = {m,n) \ (m,n,m,n) £ A}. Clearly, 
A C F X F, and |F| > L. 


M 



a £ SU°°{I?) 
c£SU°°{I? X F) 
H £ StOPVIlf}) 
Hf £ 5'tM~(K) 

jCgo 

d£SU^{I?) 



Figure 3: The construction diagram. 


We follow the construction depicted in Figure 3, one mapping at a time. 

(i) We start with an arbitrary positive semi-definite bi-infinite matrix A £ 
^“(Z^ xZ'^), and its matrix square root B £ xl?') [28]. Let S be 
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a fixed collection of independent random variables that forms a countable 
basic sequence in RV indexed by 1?. Let a — B£ be a discrete stochastic 
process in 

SU°°{IJ^) =£“[Z'^;RV] = 

a: —)• RV such that \\o-\\= sup < oo >. 

Similarly to the proof of Lemma 2.4, it is easy to see that llallst^oo^^rf) = 

1 

||^a|||oo(g 2 dp where Ra stands for a bi-infinite matrix of covariances E{aa*} 
The map Sqrt: A i—> a is bounded and bounded below, since 

lla|lL»(z=) = Palloo = \mBe£*B*}\\^ = \\BB*\\^ = P||^, 

(ii) As the set T is finite, we can trivially identify with x 

r). We can now relabel and “decorrelate” in part the random variables 
{cik,i)-y = CLk.i\r\+-y to produce the desired autocorrelation pattern A in the 
7 variable by setting 

ier 

Here, Q: T x T —>■ C is an invertible scalar-valued matrix that satisfies 
QQ* = Y with Y such that suppV = A. A choice of a positive definite 
matrix Y with a given admissible support set A is always possible by 
constructing a strongly diagonally dominant matrix and using that ( 7 , 7 ) S 

A for 7 G r. The covariance of c then satisfies | = 0 for 

all ( 7 , 7 ') ^ A, that is, it is supported on a cylinder A. We have the norm 
equivalence 


— sup SUp||Cfe 
k,l ■y 

= sup sup||(Qjjy X \\(i\\sti'=°n?xT), 

k,l 7 

that is, the mapping l: SU°°{1?) —>■ x L), a >->• c is also 

bounded and bounded below. 

(in) We define a synthesis map E: x T) —>• S'tOPW(C/) 

E{c)=H= Y, Y ^\k/a Bam^+Xl/h ^hn^—Xk/a 

k,leZyGr '' -——-^ 

where, as in Lemma 4.2, the operator Pk,i,m,n has the spreading function 
M{xk/a,xi/b) T(am,bn) ?7o(L ^)- It IS casy to verify that the operator H has 
a spreading function 

riE = EE ^k,l./y ^^(Xk/a,Xl/b) ^bn~^) 

fc.ieZ7Gr 
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We abuse the notation slightly by denoting 7 = The map 

E: SU°°{I? X r) — >• S'tOPW(17) is stable and bounded because 

ll■^llstOPW(C/) = ^)llsiM“(B2) 

= W^VE (^i )||m°°(R4) 

= E E E Cfe,i, 7 (w) M[xk/a,Xl/h) T( am^,6n-y)^n (^7 


k,l^Z 7 Gr 

X E E Ck',v,~i'{^) M(^xk' /a,Xl'/b) 7^ ) 

E E ^A:',/',7'} ^{Xk/a,\l/b) ,bn~^) 




fc,Z,/c',Z'GZ 7 , 7 'Gr 


^ ^{\k'/a,\l'/b) ,&n ^/)'^□(^^7 ^0 






^ \\{^k,i,j}i;i^z,'yer\\ste'=°{z^xr), 

where we used the fact that 7 fc,i,m,n ® r]k',i',m’,n' is a Riesz basis for its span 
(by Lemma 4.2). 

(iv) Now, given a stochastic operator H S S'tOPW(17), we apply the evaluation 
functional <&/: StOPW{U) —)■ to obtain 


$/iT = Hf. 


(v) By assumption, (A^a) (A^/3) < 1, therefore, the Gabor system 

G = {gpq = Mx2^p 2^2/35 <?o}p qg2 

and hence, the tensor product system 

G ‘^G — {Sp,q,p',q' = 9p,q G 9p',q'}p^q^p’^q' 

are frames by Theorem 4.1. Thus, the analysis map (with respect to the 
frame G given by 

Cpq : StM^m ^ ^ ^ {{^,9p,q)}p^q^z 

is bounded and stable, since for all d = Cg^ip we have 

ll^llst^°°(Z 2 ) ~ l|-^d||^cxj( 24 ) = sup \\K {if, gpq) {ip, gpi^qi)\\-^ 

p,q,p',q'GZ 

= sup K^i^jjgp.g.p'.g')! ^ II^¥’IIm'=°(R 2) “ ll‘^llstM“(K). 

p,q,p',q'GZ 
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(vi) Let us denote D = 'E{dd*} the covariance matrix of d = {Cgg o ^f o E o l) a, 
and compute 


Dr, 


/ {Dk^l^m,n f, 9p,q) 

{m,n),(mtn per 


M„ 


^ {,Dk\l\m'^n' f, dp^q'} ^m,n,m',n' 

^ ^ -^k,l,m^n;k',l\m',n' •^^p^q\k,l^m,n •^^p\q'\k\l\m\ri 


k,L,k'J'G^ 

{m,n,mtn^)eA 


or, in a matrix form, 

veci? = (Af 0 Af)|^ vec A. (19) 


(vii) Denote for brevity M = (A1(8)A1)|^ the above map that acts on bi-infinite 
matrices x Z'^) (implicitly identified henceforth with infinite vectors 

i°°(Z^)). By assumption, M does not have a bounded left inverse, that is, 
for any e > 0 there exists a vector x G ^“(Z®) such that ||a;||^cx=( 2 S) = 1) 
but II (A1 0 Al)|^a;||^oo(z4) < £• We can now trivially identify a compactly 
supported vector x G £°°(Z®) with X G £°“(Z^ x Z^), a bi-infinite matrix 
with finitely many nonzero entries such that 


(viii) Due to the tensor product nature of the map Ai® Ai and the symmetry 
of the set A, 


[MX* 


'p,q,p,q 




^ ^ \k',l',rri',n' •^*^p,q-,k,l,rn,ri ^k',l',m',n'-,k,l,m,r, 


= {{A4®M)\j^veciX)) 


= {MX)pt^qi^p^q. 


Thus, the conjugate transpose matrix X* also satisfies ||W*||^ = 1 and 
||MA*||^ < e. Furthermore, consider hermitian matrices Xi = 
and X 2 = ■ Since X = Xi + 1 X 2 , by reverse triangle inequality, 

max(||Ai||^, 11^211^) > Let the maximum be obtained by Xi without 
loss of generality. By triangle inequality, 

ll^^llloo = ^lloo < ll^^lloo < 
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Since the square root map Sqrt, the rearrangement map i, the synthe¬ 
sis map E, the analysis map Cg^, and the covariance map Cov are all 
bounded and bounded below (see the diagram on Figure 3), as well as the 
inequality ||i?|l5toPW(c/) - ll»7llstM“(M2) proven in Theorem 2.8, there 
exist constants K,K' > 0 such that 

II^«'/IIm“(r2) — ^ I1^II£<»(z2xz2)' 

We can now select a pair of positive semi-definite matrices Ai = {K + 1) Id 
and A 2 = Ai + Xi/{K\\Xi\\^) such that \\Ai - ^2||fc=o(z2xz2) = ^-rid 
IlMAi — M242 ||^oo(z2xz2 ) < £• The corresponding operators Hi,H 2 G 
S'tOPW(?7) then satisfy 

||i?7j„i —||^oc.(]u4) > 1, and \\RHif—RH 2 f\\M°°{R'^) = Ke/2 ^ 0. 


□ 

Thus, the identifiability of StOPW(U) by a fixed signal / is tied to the 
invertibility of a bi-infinite matrix {Xi 0 where X4 depends on /. We 

identify several cases for the geometry of U in which the bi-infinite matrix fails 
to be bounded below: the case of the excessive volume, vol (U) > 1, or the 
presence of two types of defective patterns. Defective patterns are explored in 
detail in Section 5. 

These results follow as corollaries from a general and rather technical The¬ 
orem 4.5 that guarantees that if we can find a growing sequence of singular 
minors within M that are dominated by A-slanted diagonals, and the matrix M 
has decay away from the slanted diagonal, then the matrix M does not have a 
bounded left inverse. 

Definition 4.4. [29, 16] We say that the entries of a matrix M: £p^(Z'^^) —>■ 
£P 2 f^^d 2 ^ (iecay away from the A-slanted diagonal if for some positive constants 
ri,r2,r > 0, 


< u;(A||z2|Io. - ll^ilL) (1 + Ikillo^r (1 + IN2|lo.r 

for some decreasing function w(x) = o{x~^),x G K. 

Consistent with the standard linear algebra literature, we call the submatri¬ 
ces 


M[n,\n] 


M,. 


UilL<Aiv,||z 2 lL<iv 


the X-slanted principal minors of dimensions {XN,N). 

Theorem 4.5. Let 1 < Pi,P 2 < 00, jiy + ^ = 1- Tet M = —>■ 

(P'i(^jd 2 '^ 6e a complex bi-infinite matrix that has the following properties. 
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•II <iv 



• II < AiV . 


Figure 4: A A-slanted principal minor. 


the entries of M decay away from the X-slanted diagonal, that is, 

< w;(A||z 2||^ - INill^) 

for some rapidly decreasing function w{x) = o{x~^) for any r G K+, 

and for any Nq G N there exists N > Nq such that the slanted principal 
central minor 

M[n,\n] = 

is singular, 

then M has no bounded left inverses. In fact, for any e > 0, there exists a vector 
X e such that ||a;||p^ = 1 and ||Mx||p^ < e. 

Proof. The proof is similar to the proof of [16, Theorem 2.1]. We provide it in 
Section 6. □ 

We will show that a bi-infinite matrix M = {M. ® A4)|^ defined in (19) 

— upon rearranging the indices to take advantage of the sparsity of the set A 

— exhibits the above decay phenomenon. It is important to note that only in 
Theorem 4.7, we need to require A > 1. 

Lemma 4.6. Let the set A be an admissible set in the sense of Equation 13. 
Further, assume that |A| = , and index the entries of A by j,j' = 1,..., J, 

that is, (m, n, G A. Upon transformation of variables, namely, 

a = k, T = IJ + j, a' = —k', t' = I'J + j', 


||zi||^<AiV, ||z2lL<iV 


0) 


(ii) 
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let the matrix M: x Z^) —>■ x Z^) be defined as 




where A4 is given in Theorem 4-3, with the constants a, fi are fixed to be a = ^, 
and /3 = ^. The matrix M = (Ad 0 ■^)|a decay away from the X-slanted 
diagonal property from Definition 4-4 with ri = r 2 = 0 and an arbitrary r G N, 
that is, 


\M, 


p,q,p,q,<^,T,(7',T' 


< w( 


M\[P q P' 9']lloo). 


where w(x) = o^|a:| ’"j for all r S K. 

Proof. Here it is crucial that the amount of active boxes in a pattern is a perfect 
square J^. This can be easily achieved by refining the rectification and by 
allowing to increase A. The following analysis is the same as in [3], only with 
2D indices. 


m: 


cr.r.cr ,t 










m' . ... ,n‘ 


(jyj')’ { 3 , 3 ') 


k',V,m' .f ){f ^ f)i 9p,q ^ 9p',q' 

(3y3') 


^(3,3')^'^U,3') 

= \{MxWa ^am+Al/6 P 3^—Xl/b ^hn—Xk/a ^; §p,q) | j 


( 20 ) 


where we use upright letters for two-dimensional indices and simple tensor prod¬ 
ucts, that is, P = P®P, f = f®f, k = (k, —k'), 1 = (I, l'),ra = n = 

(n(jj/),-n'(^._^.,)),p = ip,p'), and q = iq,q'). Also, j = (j,j'),a = (a,(7'),z = 

By Lemma 4.2, the properties of P are such that for any (|)(a:) S AI°°(M.'^) 
and any r G we have the decay 

|P(^(a:)| < ll»^llM<»(K2)'^o(a;) = 

hence, for some di(a:) = o(^\x\ 

Pam-Aj/6 |P(^(a;)| < |i(^|!M~(R2) SUp Tam- \j/b do{x) = M di{x) . 

In particular, we continue (20) with (])(a;) = T_xi/i, Mb„_Ak/o f and x = IJ -|-j, 
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noting that |i(^||Moo(R2) = ||f||M~(R2), 

^p’q’p',q' ~ I (-^Ak/a ?"am+Al/h P P-Al/b -^hn-Ak/a f, -^A^ap ^A^/Jq gO,o) 

< (PAl/bP’om|P‘l>|, TA^/Jq go.o) 

= {T\(U+3)/ibJ)Tani-Xi/b\P^\,Tx2i3q go,o) 

^ l|f|lM“(R 2 )(’PAT/(bJ)(<^l ® di),Tx 2 i 3 q go,o) 

= PllM“(R2)(^j^(T-A/3bJq)('^l ® ^l)j §0,0^ 

< l|f|lM“(R2)W'i(T - A/ 36 Jq) wi{t’ - XjdbJq'), 


= o(kl 

Similarly, by taking the Fourier transform on both sides of the inner product, 

dp’qy’q' = I (A^Ak/a ^’am+Al/b ? 'P-Al/6 -Affen-Ak/a f) Mx^ap Tx^/3q gO.o) | 

= \{Txk/a M-am-Xl/b P T-Xl/b Mbn-Xk/ai,Tx 2 ap |M;^2,gq go.o|)| 

^ (^A(o_Aap)l-^P‘l>l)gO^) 

^ l|f|lM“(R2)^PA(o_Aaap)('^0 ® do), g0,0^ 

< l|f|lM~(R2)«^2(o- - Xaap) W2{a' - Xaap'). 


where wi{x) = (r^^di, go'j 


where W 2 {x) = {Tx^do, ghj, and we justify our choice of a and /3 by observing 
6/3J = 1 and aa = 1. The proof is complete by setting 

w;(a;) = max{||wi||^wi(x), ||w 2 |loo^ 2 (a;)} = o(x“’') for all r e N. □ 

We are now ready to complete this section by proving the main theorem. 

Theorem 4.7. If an admissible bounded measurable set M C has vol (M) > 
1, the class StOPW{M) is not identifiable by any f € 

Proof. By the theory of Jordan domains, for any such M we can find a subset 
U oi M with a precise symmetric (a, b, A)-rectification U such that vol (U) > 1, 
and at the expense of further refinement of the lattice, we can guarantee a 
parallelepiped count to be a perfect square, |A| = . Consider that the volume 

of U is precisely {abY{j‘^) = [J/LY > 1- Therefore, we can choose 1 < A < 

such that selecting the constants ct = satisfies the requirement of 

Theorem 4.3 necessary for the system ^ to be a frame. 

X'ia/d = X^^= X^^ < 1. 
abj J 

Thus, the conditions of Lemma 4.6 are fulfilled, and the there defined matrix 
M decays away from the A-slanted diagonal. 
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It remains to observe that whenever A > 1, we can always find a 1 < 
A' <^such that there^ exists a growing sequence of A'-slanted principal mi¬ 
nors M[ 7 v,A'Ar]: N] ^i6JV matrix M that are singular, since for 

N sufficiently large, [A'A^J > N. Therefore, the Theorem 4.5 holds, the matrix 
M is not stable, and neither is the evaluation operator This proves that 
the set S'tOPW(17), and hence, its superset StOPW{M) is not identifiable by 
any /. □ 

5. Defective sets 

In [11], we have described the geometrical conditions on the rectification 
pattern A of M that prevented the identifiability by delta train, based on the 
condition in Theorem 3.3 that the matrix G 0 G|^ must be invertible. It turns 
out that the state of affairs is not the deficiency of delta train identifiers me, 
but rather a consequence of the tensor product structure of the autocorrela¬ 
tion support. In this section we show that the sets that we determined to be 
unidentifiable by weighted delta trains, remain so even if we allow / to be an ar¬ 
bitrary distributional sounding signal. We suggest to call such patterns globally 
defective. 

In [11, Definition 10], we defined a pattern to be defective it a weighted delta 
train could not identify the corresponding operator classes. We discovered two 
families of patterns that were defective in that sense. We extend the definition 
of the second family here and show that these patterns are indeed globally 
defective. 

Definition 5.1. Let T C be a set such that jT] = L^. Let A C L x T be an 
admissible set in Z'*. Let the graph G on the vertices indexed by L be such that 
its adjacency matrix is the indicator matrix Wa. If for some sets ri,r 2 C L 
such that Li n r 2 =0, and [Lij -|- jr 2 l > L, 

(i) the graph G contains two disjoint complete subgraphs ATpi and Ky 2 (that 

is = 1,2 is a complete graph on the vertices in Lj), then we say A 

contains a two squares pattern on ri,r 2 . 

(ii) the graph G contains a complete bipartite subgraph ,r 2 j then we say 
that A contains a butterfly pattern on ri,r 2 . 

We give examples of each type of pattern in Figure 5. 

Theorem 5.2. Let M C have a precise symmetric (a, b, A)-rectification such 
that A contains a two squares pattern onTi,T 2 as defined in Definition 5.1, that 
is, jrij-|-jr 2 l > L-|-l,rinr 2 = 0 , and (Ti x r 2 ) U (r 2 x Ti) C a. Assume 
also that jA] = for some J S N. 

The class StOPW(M) is not identifiable by any f S M°°(M.), that is, for any 
e > 0, there exists an operator H S S'tOPW(M) such that ||^?/|l 5 tM“(M) < 

^li-^llstOPW(M). 
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(a) K 2 U K 4 , “two squares” 






(b) Ks s, “butterfly” 


Figure 5: Defective patterns, L = 5. 


Proof. The case J > L is covered by the Theorem 4.7, so we can assume that 
< JjL < 1, A to be chosen later. The proof will follow the same lines as the 
proof of Theorem 4.7. 

The system Q = is a frame, if we choose a = fi = 

yb so that 

bj 

A4ct/3 = A^^T = < 1- 

abj J 

By Lemma 4.6, the there defined matrix M has decay away from the A-slanted 
diagonal. In order to apply Theorem 4.5 and Theorem 4.3, we need to show 
that for some A'^ A there exists a growing sequence of singular A'-slanted 
principal minors of the matrix M. However, here, due to A < 1, these 

submatrices are tall and skinny rather than short and fat, as in the case of 
excessive volume, so a closer look is necessary. 

For a fixed N and A' < A to be chosen later, let M[jv,A'Ar) be a A'-slanted 
principal minor 




M 


p,q,p',q';iy,r,a',T' ■ 


II [P Q P' 9']||^<^, II [o- T cr' r'] 11^ < [A'iVj . 

Consider the variable transformation 

a = k, T = IJ+j, <j' = —fc', r' = I'J+j', (jn,n,m\n') = (rrij,n^-, to'/, n'/) S A. 
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We are guaranteed to have || [cr r tr' r'] ||^ < [A'iVJ if 


\k\,\k'\ < LAWJ, 


i,in< 


[A'A^J - J 
J 


= N'. 


< X'N 


•II <A^ 


Ml 


Mo 




Figure 6: The A'-slanted principal minor M[jv,A'Ar] and its column submatrices 
Ml, Mo- 

Let us denote Mi, Mo, Ma and Mf^n the submatrices comprising columns of 
Min, X'N] such that |fc|, |fc'| < [A'fVj, |Z|, < N' and {m,n,m',n') S Fi x Fi 

(respectively, F 2 x F 2 , A, and (Fi U F 2 ) x (Fi U F 2 )). We will also denote the 
corresponding index sets Ii,Io,Ia and Ifuii, for example, 

/a = I (cr, T, a', t') (21) 

1^1, \k'\ < ) I^Ij I^^I ^ (nij n, m, n) G a|. 

We will show that the submatrix Ma does not have full rank. 

Since (Fi xri)n(F 2 XF 2 ) = 0, the submatrices Mi and Mo do not overlap. 
We will show, however, that their respective ranges intersect. Observe that 
Mi = Mi O Mi, i = 1,2, where 


M, = 


b|,kl < N,\k\ < [A'iVJ, |Z| < N',{m,n) G F, . (22) 


The column spans of Mi and Mo in a (2iV + l)^-dimensional ambient space 
have dimensions (2[A'iVj + l)(2iV' + l)|Fi|, i = 1,2. For N sufficiently large, 
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they must have a nonempty intersection, because 


(2[A'AfJ + l)(2iV' + l)(|ri| + |r 2 |) > {2\'N - 1) 

, L 1 


2{X'N-1) 

J 


-1 (L + 1) 


= + 0{N) > (27V + if 

whenever (A')^ > We can always find two distinct real numbers A and A' 

such that 


J 


L+1 




(23) 


for J < L, for example, A' = ^jf^,X = y f ■ Therefore, there exist nonzero 

vectors hi G Dom(Adi) and &2 € Dom(7W2) such that Mihi + Ad 2^2 = 0. It 
follows that for the vector b given by 


b = 


&i(g) hi 

62 


} h 
) h 


we have [TVfi | 7 W 2 ] 6 = 0. Therefore, padding 6 with zeros if necessary, we have 
found a non-trivial vector in the kernel of TWjjv.a'at]- By (23), the condition 
(ii) of Theorem 4.5 is satisfied, and the bi-infinite matrix M does not have a 
left inverse. Hence, the evaluation operator 4)^* is not stable, and the class 
5'tOPW(7Vf) is not identifiable by /. □ 

The case of a butterfly defective pattern is proven similarly. 

Theorem 5.3. Let TVf C have a precise symmetric (a, 6, A)-rectification such 
that A contains a butterfly pattern on ri,r 2 as defined in Definition 5.1, that 
is, iTil -I- |r 2 | > L l,ri nr 2 = 0 , and (Ti X r 2 ) U (r 2 x r 2 ) C a. Assume 
also that |A| = for some J G N. 

The class S'tOPW(7Vf) is not stochastically identifiable by any f G 
that is, for any £ > 0, there exists a operator H G S'tOPW(7W) such that 
\\^f\\stM°°(R) < ^ll-^llsiOPW(M). 

Proof. Following the same construction as above, with the same A, a and fi, 
consider the same matrices THfun defined in ( 21 ), and Mi, M 2 , defined in ( 22 ), 
and the vectors 61 G Dom A4i and 62 G Dom A 42 that satisfy A4i6i -|- A 4262 = 
0. The matrix Mf^n can easily be seen to be a tensor product [Adi Mf ® 

\Mi M 2 ] ■ Consider a matrix supported on /a C Ifuii ■ 


B = 


- Ti -r2 

0 62 0 61 

—610 62 0 

0 0 
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Then 


Mfuii vecB = [Ml M 2 ] 0 [Ml M 2 ] vecB 
= A^2^2 ® Mlibi — Mlibi 0 A^2^2 
= 0 . 


Thus, the matrix Mfun has a non-trivial vector vec B in its kernel. Since B is 
supported on /a, the submatrix M\ is also singular, and hence, so is 
By Theorem 4.5, the bi-infinite matrix M does not have a left inverse. By 
Theorem 4.3, the evaluation operator is not stable, and the class 5'tOPW(M) 
is not identifiable by /. □ 


6. Invertibility of bi-infinite matrices 

We generalize the invertibility [16, Theorem 2.1] to the case of different 
dimensions di,d 2 for the input and output spaces and allow slant A < 1. The 
proof largely follows the proof of [16, Theorem 2.1]. 

Counting all the elements the 2d faces of the cube in d dimensions with side 
2K, we denote 

f{d,K) = \{z G such that \\z\\^=K}\ = 2d {2Kf-^ = d2'^ (24) 

Theorem 6.1. Let 1 < pi,P 2 < 00 , ^ ^ = 1- ^ = [-^^ 2 , 21 ] ■ — >• 

£P 2 ^ g complex bi-infinite matrix such that for some X > X' > 0, we have 

(i) the entries of M decay away from the X-slanted diagonal, that is, 


< u;(A1|z2|Io. - ll^llloo) (1 + Ikllloo)’'^ (1 + ll^2|lo.)’'^ 

for some decaying function w = o^ja:] where r > ^ ^ ri r 2 , 

and the positive constants ri, r 2 G K+ satisfy 


r > 


di ’ 


1 di d2 

and r > r 2 -1-1-, 

di di P2 


(ii) and for any Nq G N there exists N 2 > Nq such that the submatrix based 
on a X'-slanted diagonal 


M = 


M, 


22,Zl ' 


\Zi\\^<X'N2, ||z2||^<iV2 


is singular. 

then M has no bounded left inverses. In fact, for any e > 0, there exists a 
compactly supported vector x G {Z‘^^ ) such that l|2;||p, = 1 and \\Mx\\p^ < e. 
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Figure 7: A A'-slanted principal minor M[jv,A'Ar] of a matrix exhibiting a decay 
away from the A-slanted diagonal. 


Proof. Fix some N 2 to be chosen later, and A^i = [A'fV 2 j in such a way that a 
submatrix of M given in (ii) has a non-trivial kernel. Let a vector x be such 
that ||i||p^ = 1, and Mx = 0. We define x G by padding with zeros: 

lkl|loo<^l> 

[O, Ikl|loo>^l- 

Clearly, {Mx)^^ — 0 for all Z 2 such that II 22 II 00 — -^ 2 - We now estimate 
{Mx)z 2 i^or all ||z 2 || > A^ 2 - Fix such a Z 2 . 

\{Mx)z2\'^" =\ 

lbilL<Wi 

<11^11^, E 

lbilloo<^i 

< (1 + E (1 + ll-illoo)^^" n;(A||.2||^ - Ikill^r 
<{i + \\z2\\^r''HNi + ir^^ E wihrfid,,h). 

ki<M\^2\\^ 


where for each ||2:i||oo tiie number of summands is f{di,ki), f given in (24). We 
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lkilloo<^i 



* 




0 



* 



0 


* 



0 


* 


M 


0 



* 






0 





0 






||^ 2 ||oo < ^2 


Figure 8: The positions of non-zero components in x and Mx. 


can now compute 


\\Mx\\ii= Y. 

lh2lL>JV2 


IF 2 |U>JV 2 

X j Y w{kiY^ f{di,ki) 

\^lh2||„-Afl<fcl<A||z2|U 
< da 2'^= (iVi -h (a di 2‘^i) n 


P 2 

91 


X ^ (fca + ( E wikiy^kY^y\ 

k2>N2 \k2-Ni<ki<\k2 

(25) 


where we denoted /ca = ||z2|ioo definition of / in (24). Consider 

Afca — ki > XN 2 — A'iVa > 1 for N 2 > Nq = 2|’(A — A')“^]. We estimate the 
sums with the integrals, letting a; = fca -f 1 and y = ki. 

P2 

Y (^2 + ( Y w{kiy^ kY^) 

k2>N2 \k2-Ni<ki<\k2 

l-ao /.A(a;-1) ra 

< / 2.P2i-2+d2-i f / w{yY^ dy j dx 

Jn 2 + 1 X(x-l)-Ni-l ' 


35 













let w{y) 


v{y) y such that v{y) G C'o(M) and s = qir — di > 0 

l-ao . £2 

< / ^P 2 r 2 +d 2 -i / / v{yy^ dy j dec 

Jn2 + 1 ^J\{x-1}-Ni-1 ' 


< llvl 


|P2 


< V 


\P 2 


X 


,P 2 »’ 2 +d 2 -l 


IN 2 + I 


^A(x-l) 





da; 


X 


.P2r2+d2- 


IN 2+1 


f- 

\s 


\(x-l) J 


Apply Lemma 6.2, let C = C{v, X, X',r,p 2 ,qi,di, d 2 ), possibly different on dif¬ 
ferent lines, and let B = —P 2?'2 — ^2 + |^(s -I- 1), also guaranteed to be positive 
by (i). Simplify 


< C 


X 


,P2r2+d2- 


/ N 2 +I 


= C{Ni + l)'^ [ 
Ja 


1 ((A^i-h 1) "" da; 

a;-^-i da; 


W2-1-1 


= C'(Afi-hl)^(iV 2 + l) 


-B 


We remember Ni = [A'A^ 2 j and finally return to estimate (25) 

\\Mx\\j,^ = c{Ni + iN2 + <ciN2 + iy^^~^, 

where we used again that N 2 > Nq. For any fixed e we can now find N 2 large 
enough so that ||Ma;||p^ < e, because by (i), 

IB d2 di 

riH-=ri-l-r 2 -l-1- r<0. 

qi P2 P2 qi 


□ 

Lemma 6.2. Let N 2 > Nq = 2[(A — A')“^] and Ni = [A'A 2 j with X' < X. For 
X > N 2 + 1, we estimate 

{X{x 1)-’' - (A(a; - I))"’’ < ^(A, A', r) x-'^-^ (TVi -h 1). 

Proof. Denote for brevity a = X{x — 1) > XN 2 and b = Ni + 1. Let t = b/a. 
Observe that for A/ > A^q = 2|"(A — A')“^] > ? 

b ^ X'N2 -f 1 A\ 1 ^ A\ A - A' A -f A' ^ ^ 

^ “ a - XN 2 XN 2 2A “ 2A “ *0 < ■ 

Consider the convex function f{t) = (1 — ty^ — 1 for t G [0,1). Since /(O) = 0, 
we can estimate 

^ liy^t = C{X, X') t for alH G [0, fol¬ 
io 
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We can now bound the original quantity 


(a - 6)-’' - a-’' = a-''((l - t)”’' - 1) < a"’’ C t = C" (a; - 1) 


—r—1 


It remains to observe that for x > N 2 +I, we have (a:—1) ^ < x ’’ 

and 


X — 1 


< 1 - 


1 


< 1 - 


1 

Wo 


< 


\ + \' 


which can be also absorbed into the constant. 


{W + 1). 


= C(A,A',r), 

□ 
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